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COMPUTATION OF OPTIMAL OUTPUT -FEEDBACK 
COMPENSATORS FOR LINEAR TIME-INVARIANT SYSTEMS 

by 

LOREN KERRY PLATZMAN 

Submitted to the Department of Electrical Engineering on May 12, 1972 in 
partial fulfillment of the requirements for the Degree of Bachelor of 
Science. 


ABSTRACT 

The control of linear time-invariant systems with respect to a quadratic 
performance criterion is considered, subject to the constraint that the 
control vector be a constant linear transformation of the output vector. 
The optimal feedback matrix, F*, is selected to optimize the expected 
performance, given the covariance of the initial state. 

It is first shown that the expected performance criterion can be expressed 
as the ratio of two multinomials in the elements of j?. This expression 
provides the basis for a feasible method of determining F.* in the case of 
single- input single-output systems. 

A number of iterative algorithms are then proposed for the calculation of 
F* for multiple input— output systems. For two of these, monotone con- 
vergence is proved , but they involve the solution of non-linear matrix 
equations at each iteration. Another is proposed involving the solution 
of Lyapunov equations at each iteration, and the gradual increase of the 
magnitude of a penalty function. Experience with this algorithm will be 
needed to determine whether or not it does, indeed, possess desirable 
convergence properties, and whether it can be used to determine the 
globally optimal _F*. 
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CHAPTER I 

INTRODUCTION 

This thesis constitutes an attempt to overcome a hurdle which has 

hampered recent attempts to apply modern control theory to classical 

control problems: a class of simultaneous non-linear matrix equations. 

The output-feedback problem was selected as a framework, for it provides 

a fine illustration of the way these equations can prevent new theoretical 

results from being implementable in practice. In order to illustrate 

this better, a brief review of the history of this problem is in order. 

The design of servomechanisms is generally acknowledged as the first 

control problem to be studied extensively, and to inspire the development 

of theoretical tools to aid in that design. * These theoretical tools 

involved frequency domain transformations, and were most effective in 

dealing with single-input single-output time-invariant linear systems. 

3 

This general body of knowledge is known as classical control theory , and 

although the theory was applied with some success to stochastic problems, 

it has, thus far, been found inapplicable to time-varying problems. 

Meanwhile, the application of linear algebra to similar problems led 

to reformulation of the servomechanism problem into the so-called "linear 

regulator problem." In particular, results obtained by R.E. Kalman 5,6 

7 8 9 

provided motivation for the development of modem control theory. * * 

There exists, however, a large gap between the current state-of-the- 
art of classical and modern control theories. For, whereas classical 
theory is most successful in dealing with single-input systems, modern 
control theory requires feedback of the entire state — a number of 
independent noise-free outputs equal to the order of the system. When 
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these outputs are not available, the state must be reconstructed using a 
Kalman-Bucy filter, or an observer. 10 The physical implementation of 
either can be quite costly, and, occasionally unwarranted. 

There has been considerable 'research in recent years, the purpose 
of which was to close the gap described above, but every attempt seems 
to reach the same point, and collapse. The problem can be described in 
the following way: Both the linear regulator and the Kalman-Bucy filter 
have solutions which apply to time-varying, terminal-time problems. The 
solution involves the backwards integration of the differential Riccati 
equation, starting at the terminal time. 

The differential Riccati equation is shown below: 

K - A’K + KA + £ - KBR~ 1 B , K (1 ' 1} 

where A, £, B, and R are known time-varying matrices . 

This equation has two remarkable properties (for suitable values of 

<£, R, and K(T)), 

1. The value of K(t) when integrated backwards remains bounded. 

2. As t - 00 , K approaches a unique limiting value. 

In particular, when a time-invariant problem is being solved, this 
unique limit can be used as the constant value of K. 

When we attempt to limit ourselves to output-feedback only, we get 

a variation of the Riccati equation. 

K = A'K + KA + q ~ M , KBR~ 1 B , KM (1-2) 

where M is a messy expression. 

The marvelous properties now disappear, and although a number of 
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. , 11,12,13,14 .. o 

successful time-varying gains solutions have been found, tne 

time- invariant case degenerates sooner or later to a non-linear equation 
with many solutions (or no solutions) - an equation about which little is 
known . 


There is reason to question the usefulness of the time— varying gains 
which may be obtained. Since the equations determining the values of 
these gains must be integrated backwards in time, the values must be 
calculated beforehand, and "read back" at run time, which is an expensive 
undertaking, and has inspired research on the computation of piecewise- 
constant gains for time-varying systems. ^ Furthermore, most problems can 
be modelled as time- invariant infinite-time with very little resulting 
error. However, if the reader desires a more complete survey of work in 
this area, reference 16 is highly recommended. 

We would like to remark at this time that the optimal output- 
feedback gains for a time-invariant problem may well be time-varying, as 
is illustrated in the work of Levine. 11 

In spite of this, in the interest of simplicity in compensator design, 
we may be interested in a suboptimal constant output-feedback compensator, 
because of the cost involved in implementing the time-varying or state- 
feedback alternatives. In this thesis we will propose methods for solving 
this problem according to the following outline. In- Chapter IX, the 
problem we have selected is carefully formulated, and a canonical form is 
presented which simplifies the calculations involved in following chapters. 
In Chapter III we propose a method of "direct" algebraic expansion of the 
performance criterion, which can be used for single-input single-output 
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systems. For higher orders systems, however, the treatment becomes too 
lengthy to be of use. In Chapter IV, we consider a number of iterative 
algorithms, the last of which we believe has great potential, but for 
which we were unable to prove convergence. In Chapter V we summarize 
the results we have obtained, and show how they may be applied to some 
related problems which involve the same non-linear equations in various 


forms. 
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CHAPTER II 

THE CONSTANT OUTPUT-FEEDBACK COMPENSATOR PROBLEM 

As we indicated in the introduction, the problem of designing 
limited-dimension (especially output-feedback) compensators has been 
treated in a number of ways in the literature recently. In this chapter, 
we will formulate this as a precise optimization problem, the one with 
which we will be concerned for the remainder of this thesis. We will then 
state some results obtained by others which are applicable to our problem. 
Finally, we present a canonical form for the parameters of the general 
problem, which we hope will simplify the treatment in following chapters. 


2.1 Problem Formulation 

Let the following represent a linear time-invariant deterministic 


system: 

x_(t) = Ax(t) + Bu(t) 
z (t) = Cx(t) 

where: A is an n x n real constant matrix 

B is an n x m real constant matrix 
C is an r x n real constant matrix 
x(t) is an n^vector (the state of the system) 
u (t) is an m-vector (the system input) 

^(t) is an r-vector (the system output) 

Let the control be of the form 


( 2 . 1 . 1 ) 

( 2 . 1 . 2 ) 


u(t) = -F£(t) 


(2.1.3) 
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where: F is an m x r real constant matrix. 

We wish to select F so as to minimize a standard quadratic cost 

functional: 

j = /“[x' (t)^x(t) + u' (t)Ru(t)] dt (2.1.4) 

° C o “ 

where: £ is an n x n symmetric positive semidefinite matrix 

R is an m x m symmetric positive definite matrix 
and [A, ^ 2 ) is observable. 

It is easily seen that this in itself does not constitute a well- 
posed optimization problem, for the initial state is not known, and J q 
cannot be calculated from Equation (2.1.4). Moreover the "initial con- 
dition" represents in fact a physical disturbance in the system which 
cannot be known a priori . A simple way to eliminate this problem is to 
require that the expected value of J Q be minimized, and to provide statis- 
tics describing the probabilistic distribution of the initial conditions. 
We now show that it is necessary only to provide the covariance of the 
initial condition. 

Substituting Equations (2.1.2) and (2.1.3) into Equation (2.1.4) to 
eliminate u(t) yields 

j = /°V(t)2x(t) + xUJ'C'F'RFCx^)! dt 

o t c - 

/°°x'(t)(£ + C'F , RFC)x(t) dt (2.1.5) 

*■0 

Let the initial state be 


x - x(t ) 
iio — O 


( 2 . 1 . 6 ) 


Then, it is easily seen from Equations (2.1.1), (2.1.2) and (2.1.3) that 
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s( t) - & - 


(2.1.7) 


Substituting Equation (2.1.7) into Equation (2.1.5), we have 

J = r x »e C - “ — ] ^(Q + C’F'RFC)e [ - ' — ]t x dt (2.1.8) 
o t 0 ; -o 

Defining the deterministic matrix 

/“ e tA “ MC]'t ( ^ + c'F'RFC )e [ - " ^ ]t dt (2.1.9) 

) 

and observing that the integral sign commutes with a constant. 


* ^ t. 


J q = xMCx^ 


( 2 . 1 . 10 ) 


As J is a scalar. Equation (2.1.10) can also be written 
o 


J q = tr [ x'KxJ = tr[Kx Q x^] 


The expected value operator commutes with linear operators, so 


( 2 . 1 . 11 ) 


J = E{ J } = tr [KE{xx! }] = tr [ KX ] 

O — u u O 


( 2 . 1 . 12 ) 


where 


5o 5E{ 5o^> 


(2.1.13) 


Thus X^ may be specified in such a way as to reflect the relative 
magnitude of disturbances in various "directions" in state space. If this 
information is not available, X^ may be specified as I to reflect uniform 
distribution on the surface of the n-dimensional unit sphere. 

It will later become necessary to require that X^ be non-singular . 

Finally, we observe that t may be taken to be 0 without loss of 


generality. 
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To summarize, we formulate the optimization problem as follows: 
Constant Output-feedback Compensator Problem 
Given a time- invariant linear system 

jx(t) = Ax(t) + Bu(t) ( 2 . 1 . 14 ) 

^_(t) = Cx(t) (2.1.15) 

with control constrained to be of the form 

ja(t) = -Fy (t) (2.1.16) 

We wish to select a value of F for which the cost functional 


J = tr[KX ] 


(2.1.17) 


exists and its minimized. The matrices K and X^ are defined by 

K = 0 /°°e [ - ' — 1 '*(£ + C , F , RFC)e^— ' — ]t dt (2.1.18) 

X = E{x x'} = E{x(0)x ' (0) } > 0 (2.1.19) 

— o — o~o — — 

We remark that K. may also be defined as the solution of 

0 « (A - BFC) ' K + K(A - BFC ) + ^ + C’F'RFC, (2.1.20) 

2 . 2 Background 

In this section, we briefly review some results which will be of use 
in the sequel. 

Fact 2.1 If the entire state is available for measurement (C is 
non-singular) , the solution to the constant output-feedback problem is 


given by 
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F* = -R _ 1 B'n C 1 


( 2 . 2 . 1 ) 


where is the unique positive-definite solution of the algebraic Riccati 
equation. 


o = A'n + n a + £ - n oo BR _1 B'n 


( 2 . 2 . 2 ) 


II may also be defined as 


IL = lim n(t) 

t->— °° 

where: 


(2.2.3) 


ri(t) = A'n(t) + n.(t)A + 3 - n(t)BR Vii(t) 


(2.2.4) 


and 


n(0) = n = it > o 

— -0 -0 


This is commonly referred to as the Linear Regulator Problem . 

Proof The entire subject is treated thoroughly in Section 23 of 
9 

Brockett. 

Remark We observe that the solution is independant of X . 


Fact 2.2 (Levine, Johnson and Athans) 
Let 


L 

— o 


j co e [A - BFC]t x e [A - BFC] ’ t 


dt 


(2.2.5) 


then a necessary condition for F^ to be optimal is that F^ satisfy 


F = R 1 B'KLC' [CLC ' ] 1 


( 2 . 2 . 6 ) 


Proof See References 11 and 16. 


Fac t 2.3 (Kleinman) 
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Let K > 0 and A - BR 1 B , K be stable. Then each term of the sequence 
o - — — — — o 

described by 

0 = (A - 'Kfl+i + Kfl+iCA - 

(2.2.7) 

exists and satisfies > 0 

sequence converges monotonically to n^, the solution of Equation (2.2.2). 

Proof See Reference 17. 

This method is commonly used to solve the linear regulator problem. 

2 . 3 The Canonical Output Form 

In the following chapters, we will present analytic tools and com- 
putational algorithms which involve a great deal of manipulation of the 
state-to-output transformation matrix C. Having C in some preassigned form 
will contribute considerably to the lucidity of the former, as well as to 
the efficiency of the latter. With this in mind, we define a canonical 
form which requires each output component to be identical to one of the 
state components. This is accomplished by remodelling the state variable 
to conform to this requirement, leaving the input-output dynamics, as well 
as their relation to the performance criterion, unchanged. In other words, 
considering the system as a "black box," we replace it with a new "black 
box" indistinguishable from the first from the outside, but somewhat less 
complicated in the inside. We will call this form the Canonical Output 
Form . 

A compensator is optimal for a given system if and only if it is 
optimal when applied to its canonical output form. 

Consider a linear time-invariant system described by Equation (2.1.1) 


A - 


m i'<w 


is stable. Moreover, the 
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and Equation (2.1.2). 

If C is not of full rank, at least one component of £ is redundant, 
and may be ignored for purposes of compensator design. Thus, assuming 
is of full rank r, we construct 


[ r _ , Y » ... y } an orthonormal basis for the (2.3.1) 

—1 —2 — i n-r 

null space of 

(This can be done most easily by first constructing an orthonormal 
basis for the range of jC 1 — applying Gram— Schmidt orthogonalization to 
the columns of C/ . ) 

We define the m x (m - r) output complement matrix 


I' = 


and note that by construction 


Y Y' = I 


C Y» = 0 


—n-r 


Defining the n x n matrices 


C 

Y 


C'(CC') 1 IY* 


(2.3.2) 


(2.3.3) 


(2.3.4) 


we note that 

i) Since C is of full rank r, (CC ’ ) 1 exists 

ii) UV = I so U = V _1 
Defining: 

x(t) = Ux(t) 

A = UAV 


(2.3.5) 

(2.3.6) 
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B 5 UB 


C = CV = [I :0] 


Y = YV = [0:1 ] 

— — L n-r 


( 2 . 3 . 7 ) 

(2.3.8) 

(2.3.9) 


we see that the system 


R(t) = Ax(t) + Bu(t) 


£(t) = Cx(t) 


(2.3.10) 


(2.3.11) 


is 


identical to the original system, from an input-output point of view. 
The initial conditions and performance criterion can be transformed 

similarly: 
if 


x = Ux 
— o — c 


X = x x' = U x x 'U 1 = UX U' 
— o —0—0 


and if fl - 


R = R 


then i) ^ ^ 0 + ^ > 0 


(2.3.12) 

(2.3.13) 

(2.3.14) 

(2.3.15) 

(2.3.16) 


ii) /°V (t)[Q + C'F'RFC]x(t)dt = fx'(t)[Q + C , F , RFC]x(t)dt 
o J — o 

(2.3.17) 


and J is unchanged . 

We will call a system for which the output matrix has the form 

C = [L^O] (2.3.18) 

a system in canonical output form . 
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Thus, it has been shown in this section that it is always possible 
to convert a time-invariant system compensator problem to canonical out- 
put form without loss of generality. 

We also call attention to the output complement matrix , X* which is 
defined as "any matrix which satisfies Equation (2.3.3). When a system 
is formulated in canonical output form, the canonical ou tput complement 
matrix takes the form 

Y = [0:1 ] (2.3.19) 

Note that the output complement matrix is, in general, not unique. 
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CHAPTER III 

ALGEBRAIC EXPANSION OF THE COST FUNCTIONAL 
FOR SINGLE-INPUT SINGLE-OUTPUT SYSTEMS 

In the previous chapter we showed that the cost associated with the 
operation of a system with a constant output-feedback compensator may be 
viewed as a scalar function over feedback space. Naturally, it would be 
convenient to be able to derive a simple algebraic expression for J in 
terms of F. Unfortunately, such an expression is in general too compli- 
cated to be of any use. Such an expression can, however, be derived for 
the scalar feedback applied to well behaved single-input single-output 
time -invariant linear systems. 

It turns out that J can be expressed as the ratio of two polynomials 
in f, the scalar negative feedback gain. The optimal gain, f*, can be found 
by calculating the zeroes of a polynomial (computational algorithms are 
available which do this quite efficiently); but, more important is the 
insight this gives us into the nature of J(F) in the case of a multi-input 
multi-output compensator. 

3.1 Statement of the Problem 

Consider a single-input single-output time-invariant system in 
canonical output form (as described in section 2.3): 

x(t) = Ax(t) + Bu(t) (3.1.1) 

y(t) = Cx(t) = [10... 0]x(t) (3.1.2) 

The control is of the form 
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u(t) = -fy(t) 


(3.1.3) 


Let the performance criterion be defined by 
J = tr[KX ] 

where K is the solution of the Lyapunov equation 

(A - .BfC) ' K + K(A - BfC) + £ + C'fRfC = 0 


(3.1.4) 


(3.1.5) 


J and K are functions of the scalar f. 

This definition coincides with the definition in Equation (2.1.18) 
when (A - BfC) is stable, because K is then unique and is of the form 
shown in Equation (2.1.20). In this chapter, however, we extend the 
definition of J to hold whenever a solution to Equation (3.1.5) exists, 
although there is no physical interpretation for the values of J obtained 
in regions of f corresponding to unstable (A - BfC) . This allows us to 
determine an expression for J(f) without knowing whether or not the 
system can be stabilized, or, if it can, in how many distinct regions of 
f stabilization is possible. 

3.2 The Main Result 

In this section, we derive an algebraic expression for J(f). 

Step 1 

We select a value of f for which a solution to Equation (3.1.5) 
exists. A necessary and sufficient condition for this to occur is: 


A ± (A - BfC) + - A (A - BfC) (3.2.1) 

f = f ; i,j=l,2,...n 

o 
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where A.(*) denotes the i*” eigenvalue of the argument. (See Reference 
18, page 239, theorem 4.) 

If no such f exists, J is undefined for all values of f, and the 
o 

problem is meaningless. Moreover, this indicates that no f will stabilize 
the system, since the eigenvalues of a stable matrix have negative real 
parts, and therefore satisfy Equation (3.2.1). 

Define the variables: 

A = A - Bf C (3.2.2) 

— — cr~ 

hf-f (3.2.3) 

o 


P(f) i (f 2 + 2f f + f 2 )R = f 2 R (3.2.4) 

o o 

Substituting the new variables into Equation (3.1.5) we have: 

(A - B!C) 'K + K(A - BfC) + £ + P(!)C’e = 0 (3.2.5) 


Step 2 

We need the following lemma: 

3.1 Every solution K to Equation (3.2.5) can be expressed uniquely 
in the form 

K = K + k, K, + k o K 0 + ... k K (3.2.6) 

— — o 1—1 z n— n 

where the are solutions of 


A’K + K A + Q = 0 
o — o— 

A'K. + K. A + E. = 0 0 < i < n 

1 —i— —i 


(3.2.7) 

(3.2.8) 
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10 . . . 0 “ 


‘ 0 1 . . . o" 

0 0 . . .0 
• • * 

E_ = 

10 . . .0 
• ■ • 

• • • 

-2 

• • • 

• • • 


• • • 

_ 0 0 0 _ 


_ 0 0 0 _ 



" 0 0 . . . 1 ' 


0 0 ... 0 

E = 

• * • 

— n 

• • • 


• ■ • 
10 0 


(3.2.9) 


and the k. are functions of f. 
i 

Proof Let 

E = e' = A'K + KA + £ 


(3.2.10) 


The output complement matrix (see section 2.3) takes the form: 


- = ^n-l 1 " 


010 ...0 

001 ...0 


0 0 0 


(3.2.11) 


Note that, by construction of \ 


YC' - CY' = 0 


(3.2.12) 


Pre- and post-multiplying Equation (3.2.5) by Y_ and Y/ , respectively, 
and using Equation (3.2.12) we see that 

UA'K + KA + £)Y' = 0 (3.2.13) 

Substituting Equation (3.2.10) into (3.2.13) 


YeY' = o 


(3.2.14) 
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If we partition E, isolating the first row and the first column 


E = 


r^u : 

-12 


-2i : 

-22 



(3.2.15) 


is 1 x 1 

t is (n-1) x 1 


C 12 is 1 x ( n-1 ) 

£-22 is ( n_1 ) x ( n_1 ) 


equation (3.2.14) becomes 

0 = YEY' = [0:1] 


£•11 ! —12 
£-21 : —22 


0 

1 


—22 


(3.2.16) 


Therefore, we conclude that 

1) E is everywhere 0 except on the first row and the first column 

2) E, being symmetric, can be uniquely described as a linear combination 

of the E . defined in Equation (3.2.9). 

—x 

Thus, defining the k. so that 


E = 


m 

- 

1=1 


(3.2.17) 


lbstituting Equation (3.2.10) into Equation (3.2.17) 


m 


A' K + KA + £ + 2j k.E. = 0 
i=l 


(3.2.18) 


by superposition, the solutions of Equation (3.2.7) and Equation (3.2.8) 
combine to yield Equation (3.2.6). Moreover, A satisfies Equation (3.2.1), 


so all K. exist, and are unique, 
—i 


OED 
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We now calculate the scalars 


j ± i tr[K,Xj 


i — 0, 1$ • • . n 


(3.2.19) 


and the vectors 

= the first column vector of + K^BC] 

1 = 0 , 1 , ... n ( 3 . 2 . 20 ) 

This may be done by calculating a from Equation (3.2.7) or 
(3.2.8), calculating the corresponding j and ^ as defined above, dis- 
carding that K. and calculating the next K^. The fact that all do not 
have to be retained at once makes this procedure programmable on a digital 
computer without requiring exorbitant amounts of storage. 

Step 3 


Let 


We now solve for the k ± as a function of f. 


k = 


1 

K 

i— 1 

i 

h = 

" l" 

k 0 


0 

2 



• 


• 

• 


• 

. 


• 

k 


0 

n 


_ — 


(3.2.21) 


( 1 ) 


£ = 

We claim that k is uniquely determined by: 

[1+ fG]k + f g - P(f)h =0 

Proof 

Rearranging Equation (3.2.5), we have: 

- (A'K 4- KA + £) + (BfC) 'K + K(BfC) - P(f )C'C = 0 


(3.2.22) 


(3.2.23) 


(3.2.24) 
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Substituting Equation (3.2.10) into Equation (3.2.24), we have 

-E + (BfC)'K + K(BfC) - P(f)C'C = 0 (3.2.25) 

Decomposing _E and K into components of magnitude k_^ by use of Equations 
(3.2.17) and (3.2.6), we have 

Sk ± [E i + (BfC) 'K. + K^BfC) ] + (BfC) + KJifC - P(f )C'C = 0 

(3.2.26) 

Rearranging: 

(S[E i + fCC'B'^ + KJBC) ]k ± ) + f (C.'B.'K^ + l^BC) - P(f)C'C = 0 

(3.2.27) 

Using Equations (3.2.9), (3.2.20), (3.2.21) and (3.2.22) we see that 
Equation (3.2.23) represents the first column of each term of Equation 

(3.2.27). 

(2) Equation (3.2.23) represents n linear equations in n unknowns. The 

A 

solution k exists and is unique when [_I + fG] is non-singular. Clearly 
it is - unless 



which can only occur for at most n isolated values of f. QED 

Step 4 

Combining Equations (3.1.4), (3.2.6) and (3.2.19), we see that 

J = j_ + C (3.2.28) 

i=l 

Thus, to obtain J as a function of f, we might solve Equation (3.2.23) 

A A 

each k. as a function of f. Since f is a parameter, not an unknown, we 


for 
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can use Cramer's rule /to obtain each ^ as the ratio of two determinants. 
Although this approach lacks practical appeal, it allows us to prove the 
following result. 

Theorem 3.1 j 

J(f) may always be expressed in the form 


J(f) /= 


where: 


L Mi 

T(f) 

S(/) is a polynomial of order at most n+1 
T (/ * ) is a polynomial of order at most n 


(3.2.29) 


Proof 

(1) Let T(/f) = det(I + f£) 

- each element of the matrix I + fG is a polynomial in f of order not more 

than 1. I 

- each product of n elements of I + f£ is a polynomial in f of order not 
more than n. 

- T(f) consists of the sum of terms each of which is a polynomial in f of 


order not more than n. 

Therefore T(f) is a polynomial in f of order not more than n. 

(2 ) k = det(M.) = S.(f) (3.2.30) 

T(f ) T(f) 

where M is obtained by replacing a single column of I + ?G by a vector, 

— i 

each element of which is a polynomial in f of order not more than 2. 

A A 

— reasoning as we did in the case of T("), we see that S_^(f) is made up 
by the sum of polynomials, each of which is of order not more than n+1. 
Therefore § i (f) is a polynomial in f of order not more than n+1. 
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(3) From Equation (3.2.28), we have 

J = j 0 + j l k l + j n k n 

= j 0 T(f) + 3^(0 + ... j n S n (f> (3.2.31) 

T(f) 

As the numerator is made up by the sum of polynomials in f, each of which 
is of order not more than n+1, we see that in Equation (3.2.29) S(f) is a 
polynomial in f of order not more than n+1. 

Corollary 

J(f) may always be expressed in the form 

T / f 1 _ MO. (3.2.32) 

T(f ) 

where: S(*) is a polynomial of order at most n+1 

T ( • ) is a polynomial of order at most n 

Proof 

Substitution of f for f in Equation (3.2.29) by means of Equation 
(3.2.3) leaves the order of each polynomial unchanged. 


In the interest of computational expediency, we propose the following 


method : 

Let G = UGU 


(3.2.33) 


be a real Jordan block form for (5. 
Then defining: 


1 - 

1 

. L_u 
M ! 

I = u'i = 

'^ 1_ 


• 


• 


j n 


_ 3n _ 


(3.2.34) 


c 
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k = U 1 k = 






h = U 1 h 


We can convert Equations (3.2.23) and (3.2.28) to 


(I + f G)k + fg - P(£)h = 0 


n 


J = 


■o —x x 


(3.2.35) 


(3.2.36) 


(3.2.37) 

(3.2.38) 


In this case, Equation (3.2.37) decouples into groups of simultaneous 
linear equations where V is the size of each Jordan block in G_. The 


determinants of size can be easily evaluated. 

Step 5 

Substitute f for f in the formulation J(f) determined. 

3 . 3 Example 

C = [1 0] (3.3.1) 

The system is in canonical output form. 

Let the performance criterion be described by: 


Let 


A = 


0 -1 
1 0 


B = 


1 

0 


4 = 


0 0 
0 1 


R = 1 


X = I 
— o — 


(3.3.2) 


Step 1 

\ A is not stable, so we must select an f which stabilizes (A - Bf C) 

— o — — o~ 

Let f = 1. Then 
o 

f = f - f = 
o 


f - I 


(3.3.3) 
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■ r -i -i i - 

A = ^ g P(f) = f z + 2f + 1 


(3.3.4) 


Step 2 

Solving Equation (3.2.7) yields 

I" 1/2 1/2 ' 

“d 1/2 1 


We retain g 
2o 


" 1/2 1/2 " 
L 1/2 1 _ 

f 1 

_ 1/2 _ 


Solving Equation (3.2.8) yields, in turn, 

[1/2 0] Til 
-1 L 0 !/2 J L 0 J 

„ _ r o o ~| _ r o 7 

-2 [_ 0 -1 J % |_ 0 J 


Step 3 


h = 1 


h -1 


*-[S] 


Step 4 


G is already in Jordan form. Equation (3.2.23) becomes 


I " 1 + £ 0 1k + { r-(£ Z + 2 £_+ 1) 1 , 0 
0 1 J— L (l/2)f J 


T - 3 , f + f + 1 , 1| 
J ” 2 + TTT^ + 2 £ 


(3/ 2) £ + 3f + 5/2 

(£ + i) 


Step 5 


Substituting Equation (3.3.3) into Equation (3.3.11) 


3 / 2 f “ + 1 


(3.3.12) 
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3 . 4 Conclusions 

We make the following claims based on the contents of this chapter. 

th , . . 

Claim 3.1 The quadratic performance criterion, J, of an n order time 
invariant system having m inputs and r outputs may be expressed in the form 


where 


J 


_ S(f 


11 ’ 


T(f 


11 * 



f 

mr 


f 

mr 


) 

y 


f _ are elements of the m x r matrix F_ 


ij 

S is a multinomial of order at most n + 
T is a multinomial of order at most n 
Proof 


1 


(3.4.1) 


2 

If the Lyapunov equation Eqation (2.1.20) is viewed as n simultaneous 

o 

linear equations in n unknowns (the elements of K) , the trace of may 

2 2 

be expressed as the ratio of two determinants (each n x n ) . 

Since each term of each determinant is a multinomial of order at most 

n 2 

2, J may be expressed as the ratio of multinomial of order at most 2 
However, any further constraint on the feedback "-of the form 


F = 



(3.4.2) 


where F is a constant matrix, x a scalar parameter, will transform the 
— o 

system into a single-input single-output form and, by the corollary to 
theorem 3.1, 


S (x) 

j = 

T (x) 


(3.4.3) 


x 

where the order of may not exceed n + 1 

and the order of may not exceed n. 

From this, we conclude that the order of multinomials in Equation 
(3.4.1) may not exceed the limits specified below Equation (3.4.1) for, 
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if there existed a term in S or T of order exceeding the limits, there 

would exist some which would map the term into a term of S x or of 

excessive order, violating the limits specified in Equation (3.4.3). QED 

Remark - This reveals the complicated nature of J (F) for systems of 

reasonable dimension, and eliminates the usefulness of the algebraic 

expansion of J for systems with more than one input or output. 

n + 1 ,n x 

Claim 3.2 The range of f may include at most — ^ — VJ lf n is even ' 
distinct regions in which the system can be stabilized by output feedback 
Proof 

In a stable region of f, J is continuous and finite. However, as 

the system approaches instability, J -*■ 00 • (This corresponds to the root 

locus crossing the imaginary axis) . Selecting J q sufficiently large, 

we see that J(f) = J must have two solutions for each distinct region of 

o 

stability. But J(f) = J q is identical to 

S(f) - J T(f) =0 (3.4.4) 

, n + 1 

which has at most n + 1 roots. Thus there can be at most — - — regions 
of stability. (Note that as f •» ±O0 » J becomes unbounded, and these count 
as, "stability boundaries.") Q ED 

Remark - This suggests a way of determining exactly the values of f at 
which a system can become unstable - clearly this may happen only when 
T ( f ) = 0, or f = -y where A is a real eigenvalue of G (see Equations 
(3.2.20), (3.2.22), (3.2.23) and theorem 3.1). 
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CHAPTER IV 

ITERATIVE APPROACHES TO THE PROBLEM 

Since the "direct" algebraic expansion has been shown to be imprac- 
tical when dealing with systems with multiple inputs or outputs, we now 
consider techniques involving iterative approximation. We will first 
consider a method proposed by Levine, and show that it converges mono— 
tonically to a local minimum in J. We then propose a penalty function 
type of algorithm which we hope will lead us to a global minimum. An 
example of the proposed algorithm is supplied. 

4 . 1 A Method Due to Levine 

We now consider an iterative algorithm due to Levine 11,16 and show 
that for any initial guess F^ which stabilizes the system, the algorithm 
will converge monotonically to a local minimum. Much of the development 
is identical to the original treatment by Levine, but he was unable to 
prove existance at each step, or convergence of the sequence. 

Iterative Algorithm 1 (Levine) 

Suppose stabilizes (A - BF^C ) , let be the solution of 


0 - (A - M^C) 'Kk + VA - + 2 + £’^-iSEn-i2 

( 4 . 1 . 1 ) 


and F , L are solutions of the simultaneous equations 
— N — N 

4 ■ R'VjWfcL^c')" 1 


( 4 . 1 . 2 ) 


0 = (A - BF C)L, + L..(A - X) ' + X 
— — — HNh N — N — w— — r 


( 4 . 1 . 3 ) 
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If a solution exists such that L >0* F. T is used to initiate the next 

— n ~ w 


iteration. Also, 

J N * “‘SA 1 


(4.1.4) 


Theorem 4.1 Provided a stabilizing F^ can be found, the algorithm 
described above converges monotonically to a locally optimal ]?• 

Outline of Proof 

A) If F stabilizes the system, K. exists and is a continuous function 

_N-i — N 

of F .Wherever L„, F„ exist, they are continuous functions of L. . . 

— N-l — N — N 

B) If F^ exists and stabilizes the system, J N+1 £ J N - 

C) The matrices L^, exist for all stabilizing F^. 

D) J converges monotonically. 

E) As J approaches a constant value, so do K, L and F. 

F) The limiting value of F corresponds to a local optimum. 

Proof 

A) Consider the space of all F^_^ f° r which (A - BF^ ^C) is stable. 

i) exists, is unique, positive definite (see Reference 18, p. 

239, theorem 4). It is easily seen that small changes in F^ induce small 
changes in K , so long as consideration is limited to the set of stabilizing 


ii) Similarly, the pair (F^, L^) is a continuous functions of K^, 

which is a continuous function of Z N _ 1 * The set of F jg _ 1 for which solutions 

F , L exist has at least one point in it - the global minimum in J. This 
— N — i N 

set is also open, since small changes in F^^ induce small changes in (F^, 
L^) , and (A - BF^C) is stable in an open set. 

B) Let us assume that F , L., exist for some FI . . 
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Then, exists > an< * t ^ ie s °l ut: *- on °f 

0 = (A - ■bf n c) , k n+1 + Kn+t^-M^c) + a. + (4 - 1 : A) 

Adding terms to Equation (4.1.1) yields 

0 = (A - BF^C) % + K,j(A - BF^C) + 5. + 

- (BF^C) 'K^ + (BF N C)'K N -K N (^ ) +K n (M n C> 

+ K^VKn - ^BR'V^ (4.i.5) 

0 = ( A - BF n C) 'K^ + K^A - BF^C) + <* + C'F^_ 1 M N _ 1 £ 

- <5Vi« '4. + '4« - V®4i-i 0 + 

+ K^'V^ - (4 - 1 ’ 6) 


Define: 


W (1) = 
-N 


[C'F^ - K^R" 1 ]!^ - R'Vk^] 


5 [C’F^ - 


,(2) __ 


6 ^N ^N+l ~ 

Subtracting Equation (4.1.6) from Equation (4.1.4) yields 
0 =( A - BF n C) ’ 6K^ + 6K^(A - BF ^ C) + 


(4.1.7) 

(4.1.8) 

(4.1.9) 


(4.1.10) 


We recall that solutions of Lyapunov equations Equation (4.1.3) and 
Equation (4.1.10) take the form 


r [A “ BF£3 1 Y J A - BF C] ' t 
■=N o J — o 


dt 


(4.1.11) 
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6 *N 


_ r e [A - M N £]'t ( (1) _ w (2) )e [A - BF N C]t dt (4.1.12) 
q j e in- V=fj- -N ' 


Factor the symmetric positive definite matrix into 


0 0 = L 

%% — N 


(4.1.13) 


Let {u'...u } be an orthonormal basis for the range of [CLC. 1 ] 

—1 — r 

(v ...v } be an orthonormal basis for the null space of [C0 ] 

— 1 -n-r 11 

and let 

U' = [u 1$ u 2 ... u^J 
V’ = [v r v 2 ... v^] 


(4.1.14) 

(4.1.15) 


U is an r x n matrix 
V is an (n-r) x n matrix 
By construction 

[U'lV'J = !_ 



(4.1.16) 


Recalling that the trace operator is invariant to cyclic permutations, 
we have 


Vi - j n ' trI %uV - tr[ W 


= tr 




- - 4 2)> V 

■ «[0 N (w< 1) - i4 2) )0„] 
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= tr 




= tr 




j4 2) )0 H s.'iu« t] (^ 1> 


u^)0 V' 




w' 2) )4U'|v« k (^ 1) 


w (2))0 V' 


(4.1.17) 


But V0 C = £ by construction, so 


i’4« - 

(4.1.18) 


= 0 


Moreover , 


ufcc'^ ’ 


= S^ , (5W’ ) ' 1 SWP 

Since range (U) = range (0C ) 

U^C’ (C^n^C') -1 ^ = U 

(See Reference 19, page 579, theorem 5. ) 

-1 

So, 


-1 


(4.1.19) 


and 


m-'h = w 

(i) 


uw v "' = o 


(4.1.20) 

(4.1.21) 

(4.1.22) 


Thus, using Equations (4.1.18) and (4.1.22), we have 


v^ 1 ’ - ^ 2)) *y2' i'i 


— — N— .-ttN — N— 


V0 W (2) 0 u’ : 


(4.1.23) 


Substituting this into Equation (4.1.17), 
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N+l 




O'] ^ 0 

— N— 


(4.1.24) 


( 2 ) 

since W^ is a quadratic form. 

C) Consider again the pair (F^,!^) . solutions of Equations (4.1.2) and 
(4.1.3). In (A), we showed that is a continuous function of Zjj_i when 
it exists. As I? x approaches a value for which there is no solution 

approaches a value which does not stabilize (A - BF^C ) . However, as 

this happens, J N+1 < J N when does exist. 

Thus, as F . approaches a value for which EV, does not exist, J N 
increases without bound and approaches a value for which A - 

is unstable. Thus, for every stabilizing F^, a stabilizing F^ exists. 

D) J N > 0 for all N, and J N+1 < Jj,. These are the conditions for monotone 

convergence of J. 

E) We need the following lemma: 

Let P be a symmetric positive semidefinite matrix with elements 

[P] . . . Then 
- iJ 


I) [P] . . < tr [P] 

— IX - 


Proof 


U) Illy ^ [Hu • [Pljj 


n 


I) tr [P] = E[?] jr ^11 [P) j:j > 0 


II) e> a re elements of the natural basis 

is a quadratic form, 


- V 

p 

e . 
—x 

L-J. 


[3 J 


(4.1.25) 

(4.1.26) 

(4.1.27) 


so 


det 


Si 

e . 
“J 


P[e;:e’] 


(4.1.28) 



- 37 


but 


or 


det(*) = - t Ply * 0 




QED 


(4.1.29) 

(4.1.30) 


Since J converges monotonically , for any t > 0, there exists an M(e) 

such that J. T - J XT , , < e for all N > M(e) 

N N+l 

From Equation (4.1.24), we see that 


tr[U0 W ( T 2) 0 U' 1 < e ; N > M(e) 
— If— 


(4.1.31) 


Furthermore, every element of 


v - 


- 1 , 


(4.1.32) 

is bounded , for the trjK^] - J N bounds the elements of 1^. From this 
we see that every element of 

!^ ! Vi 1 


V j o 


can be made arbitrarily small. 

From Equation (4.1.23), noting that |~|J and 0 are invertible, we see 

that as N + °°, ~ ] "*■ 0.* 

From Equation (4.1.12) , we see that as N + 6K -> 0. 

As K approaches a constant value, so do F_ and L, being functions of K. 
F) A limiting value of F satisfies the necessary condition (Fact 2.2). 

It also stabilizes the system, so it is a local minimum. 

This ends the proof of theorem 4.1. 

We now propose another, similar way of solving the same problem. 
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Iterative Algorithm 2 

Suppose stabilizes (A -BF^C ) ; let 1^ be the solution of 
0 - (A - BF^C)^ + V£ - 4 


(4.1.33) 


and F , are solutions of the simultaneous equations 

In = 


(4.1.34) 


0 = (A - BF m C) 'K^ + K^(A - BF^C) + £ + CF^RF^C (4.1.35) 


If a solution exists such that > 0, F^ is used to initiate the next 
iteration. Also, 


J H * "‘Vo 1 


(4.1.36) 


Theorem 4.2 - Provided a stabilizing F can be found, the algorithm 
— o 

described above converges monotonically to a locally optimal 
Proof 

The proof duplicates the proof of theorem 4.1 with the following 
changes : 

1) In (B) existance of the pair (F^, K^) is postulated, and in (C) proved 
(rather than (J^, _L^) in theorem 4.1). 

2) In (B) a few indices change. 


and 


^ ' *N-1 


(4.1.37) 


0 = (A 


BF 


N-l- 


C)'SKn 


6 VA - 


+ w (1) 


- w (2) 


(4.1.38) 


However, is now defined as the integral of (A - BF^ 1 C) , (compare 

Equations (4.1.3) and (4.2.1)), and the indices of F in Equations (4.1.11) 
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and (4.1.12) should be reduced accordingly. The remainder of the proof 
applies to this theorem unaltered. 

Each of the two methods so far proposed has the important drawbacks: 

1) A non-linear matrix equation must be solved at each iteration, and no 
method of solution immediately presents itself as applicable to the 
particular non-linear equations to be solved. 

2) An "initial guess", is required. Such a stabilizing feedback gains 
matrix may not be available to initiate the algorithm. In fact, it is in 
no way guaranteed that such a matrix does, in fact, exist; i.e. there may 
not exist any output— feedback gains which stabilize the system, in which 
case, of course, there is no "problem." 

3) The choice of the "initial guess" determines whether the algorithm 
will converge to a local minimum, or to the global minimum in J. Thus, 
one has no way of knowing whether or not a solution obtained using either 
algorithm is in fact the desired solution to the problem. 

4.2 Iterative Refinement of Values "Sufficiently Close" to the Solution 
The similarity between Iterative Algorithms 1 and 2, and the rigid 
convergence properties they possess lead us to propose the following. 
Iterative Algorithm 3 

Suppose F stabilizes (A - BF^C ) ; let and be solutions of 


0 - (A - BF^ + L^CA - BF^)’ + X, (4- 2 - 1 ) 

0 - ( A - BF n Q 'K^ + K^A - BF^C) + £ + C'F^KF^C (4.2.2) 

Then F may be used to initiate another iteration, where F .. is given 
— N+l 


F = R 
%+l - 


-1 


■b , k n l n c'(cl n c') 


-1 


(4.2.3) 
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We emphasize that convergence of this algorithm is only conjectured, 
but appears likely. The conjecture may be supported by considering the 
proof of theorem 4.1. If is assumed to be sufficiently close to 1^, 

the proof still holds in the case of Iterative Algorithm 3. This would 
seem tobeavalid assumption if is "sufficiently" close to the solution, 
F*. 

4.3 A Penalty Function Type of Algorithm 

Consider a linear time-invariant system (such as the one described 


by Equations (2.1.1) and (2.1.2)) and let D be an arbitrary full-rank 
(n-r) x n matrix such that 


1 ) 


2 ) 


C 

D 


is non- singular 


CD' - 0 

Now consider a system described by 

x(t) = Ax(t) + B(u^(t) + u^t)) 

^(t) = Cx(t) 

Z 2 (t) = Dx(t) 

Let the control be of the form 


-u l( t) ‘ 

= — 

-ii:-i2 


” C " 

x(t) = -F 

"c " 

u 2 (t) 


f„, :f_ 


• • • 
D 


D 

L J 


_ -21.-22 _ 




_ 


(4.3.1) 


(4.3.2) 


(4.3.3) 

(4.3.4) 

(4.3.5) 


x(t) (4.3.6) 


and the cost functional given by 



J = o /°° 3 c * (t)Qx(t) + +u^(t)Ru 1 (t) + u|(t)Rn 2 (t) 

+ (l+w 2 )u^(t)Ru 2 (t)dt (4.3.7) 

where w is a positive constant parameter. 

We wish to select that 1? that minimizes J. When w = 0, this corres- 
ponds to the linear regulator problem, and is known to have a unique 
solution. We will show that as w -*■ “, either J diverges or F approaches 
a solution to the output-feedback problem; selection of different I) could 
cause the algorithm to converge to different local minima. We also, propose 
an algorithm for the minimization of J for any finite w which involves 
the solution of linear equations at each iteration. 

First, we place the system in canonical output form. As C and I) 
are complementary, we can require that they take the form 

C = [IrlO] (4.3.8) 

D = [o: I ] = Y (4.3.9) 

— n-r — 


of 


We remark that each new selection of D requires a new 
the system to canonical output form. 

Let 

fo : o 1 


T 3 


• wl 

. —n-r 


transformation 


(4.3.10) 


where w is the parameter defined in Equation (4.3.7). 
We now define L and K, solutions of 
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0= (A - BF)'K+ K(A - BF) + £ + F'RF + TF'RFT (4.3.12) 

It is easily seen that this definition is compatible with the previous 
definitions. 

Using a derivation similar to that of Levine, we show that a 

necessary condition for optimality of IF is 

JF = R~ 1 B'KL(L + TLT ) 1 (4.3.13) 

The derivation is straight-forward but lengthy, and will not be given. 
Theorem 4.3 -'As w + °°, the necessary condition Equation (4.3.13) approaches 
the necessary condition for output-feedback optimality, Equation (2.2.5). 

If J remains bounded as w F approaches a locally optimal output- 

feedback solution. 

Proof 

It is necessary to show that 

lira (L + TLT )” 1 = C' (CLC')" 1 C (4.3.14) 

W-x» — — — 

provided J remains bounded (i.e. provided the limit exists). 

1) If the limit exists, 

is non singular 

2) Noting that by construction of _I, TC/ = and, so, TLTC 1 = (), hence, 

lim (L + TLT) _1 LC ' = liin (L + TLT) _1 (L + TLT)C’ 

\$-+cc — 

= c* = tc' (CLC , )” 1 Q]LC’ 


[LC'IV] = 


clc': o 


ylc ' : i 


(4.3.15) 
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lim (L + TLT) -1 r = lim (L + TLT) _1 (L + TLT) Y ' (YLY * ) 
— — w-»° — ~ 


w 


= lim i Y* (YLY')" 1 = 0 

^w 2 - V_ 

= [C 1 (CLC 1 ) -1 C] Y 1 


(4.3.16) 


Thus 


lim^a + TLT) -1 [LC':y'] = C , (CLC') _1 C[LC , :r] 


(4.3.17) 


and, as [LC ’ ] is non-singular, Equation (4.3.14) holds, and the theorem 

is proved. 

The similarity between the problem of finding the Optimal F for a 
given w, and the optimal output-feedback problem is immediately recognized, 
and we can immediately propose three algorithm analogous to the Iterative 
Algorithms 1 through 3. However, it is now possible to ensure that the 
initial guess will be arbitrarily close to the solution by making the 
increase in w sufficiently small, and solving for the optimal F for each 
value of w. We, therefore, can immediately propose an algorithm based on 
Iterative Algorithm 3. 

Iterative Algorithm 4 

Suppose F stabilizes (A - BP^) ; let and ^ be solutions of 


0 = (A - BF^Lj, + L^(A - BFj,) ' + X, 


(4.3.18) 


0 = (A - BF^'K^ + V£ " Mn> + (4.3.19) 

Then F , may be used to initiate another iteration, where F.., 1 is given by 
— N+T “TNTl 

£n + i * ■fWi* + <4 - 3 - 20) 
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We emphasize that convergence of this algorithm is only conjectured , 
but appears likely if is sufficiently close to the solution F* (for 
some particular w) . 

If Iterative Algorithm 4 does, in fact, possess desirable convergence 
properties, it may be used to determine the optimal output-feedback com- 
pensator, eliminating most of the drawbacks listed for Iterative Algorithms 
1 and 2. By selecting a number of differently weighted D, it is possible 
to obtain a reliable "solution profile" - that is: 

1) If none of the D selected caused the algorithm to converge, there 
probably is no solution; 

2) If most of the D selected converge to various local minima, but 
selection of new D causes the algorithm to converge to local minima already 
known, these are probably the only local minima. 
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CHAPTER V 
CONCLUSIONS 

In the previous chapters, we have presented two approaches to the 
computation of optimal output-feedback conpensators for linear time- 
invariant systems. We will discuss each of these in turn. 

In the third chapter, we showed that the performance of a single- 
input single— output system can be expressed as the ratio of two polynomials 
in the feedback gain. The computation of the coefficients of these poly- 
nomials, when solving the Lyapunov equations by the method due to R.A. 
Smith, involves the inversion of one n x n matrix, a tolerable number 
of matrix multiplications and additions, and the diagonalization of another 
a relatively small task. This compares favorably with the Nyquist plot 
or root locus methods of determining the "stability boundary values" - 
values of the gain at which the system becomes unstable, and has the 
advantage of yielding these values directly (algebraically, rather than 
graphically). In addition, a number of properties of the stability 
boundary as a manifold in feedback space may be deduced. 

In the fourth chapter, we proved monotone convergence for a method 
proposed by Levine, 11,16 and, in turn proposed a penalty function type of 
algorithm to handle this problem. Once again, the implementation of the 
algorithm on a digital computer may be accomplished quite efficiently, as 
it involves only the solution of Lyapunov equations and a matrix inversion 
at each step. The order of convergence of the algorithm is yet to be 
determined, and the author hopes to determine this experimentally in the 


near future. 
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Should the penalty function approach prove successful, it could be 
applied to a variety of other problems: 

11,21 

1) The linear compensator of limited dimension proposed by T.l. Johnson 
may be designed, using an algorithm almost identical to the one proposed 
for output-feedback design. 

2) The globally optimal time-invariant solution could provide a reliable 

"first guess" in computing the optimal time-varying output-feedback gains 

or limited dimension compensator, using algorithms proposed by Levine 11 
12 

or Axsater. 

3) The design of a time- invariant limited-dimension Kalman-Bucy filter, 
or solution of the limited-dimension compensator problem where measurement 
noise is present, could be accomplished. 

4) The design of piecewise constant compensators for time-varying problems 
based on the approach proposed by Kleinman, could be attempted. 
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